Web Survey Bibliography
Title Using Eye Tracking to Examine the Visual Design of Web Surveys
Author Zhou, Q., Ricci, K., Olson, K., Smyth, J. D.
Year 2014
Access date 28.08.2014
Abstract
Studies show that visual design influences how a respondent processes survey questions (Dillman et al., 2009). Sometimes the visual presentation of response options are manipulated to save space on a paper survey and to make all responses visible without scrolling on a Web survey (Couper, 2008). However, few studies have formally analyzed the effects of these sorts of graphical manipulations. In this study, we use eye tracking methods to examine the visual layout of response options in two visual design experiments: (1) a single column versus two columns of response options and (2) a linear versus non-linear five-point rating scale. Specifically, we will examine if the different layouts affect if respondents read through the response options, how long respondents spend on each subgroup of response options, and the distribution of responses selected. Data for this study will come from a general population laboratory experiment that will be conducted between November 2013 and March 2014. Preliminary analysis from a pilot study of 41 college students revealed mixed results. Initially, students spent more time looking at the one column of responses and the non-linear layout of the rating scale; on a later question in the survey, however, students spent more time looking at the two columns of responses and the linear layout of the rating scale. Although previous research has suggested that the non-linear rating scale will encourage respondents to process the options horizontally, we have observed that respondents tend to start from the middle column and use it as an anchor when processing the other options. We will investigate these trends further by analyzing these experiments with a larger sample from the general population. This study will conclude with implications for Web survey design.
Access/Direct link
Year of publication2014
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Olson, K. (13)
- The Effect of CATI Questions, Respondents, and Interviewers on Response Time; 2016; Olson, K.; Smyth, J. D.
- Identifying predictors of survey mode preference; 2015; Millar, M. M.; Olson, K.; Smyth, J. D.
- The Effect of Answering in a Preferred Versus a Non-Preferred Survey Mode on Measurement; 2014; Smyth, J. D., Olson, K., Kasabian, A.
- Assessing Within-Household Selection Methods in Household Mail Surveys; 2014; Olson, K., Stange, M., Smyth, J. D.
- Accuracy of Within-household Selection in Web and Mail Surveys of the General Population.; 2014; Olson, K., Smyth, J. D.
- Using Eye Tracking to Examine the Visual Design of Web Surveys; 2014; Zhou, Q., Ricci, K., Olson, K., Smyth, J. D.
- Analyzing Paradata to Investigate Measurement Error; 2013; Yan, T., Olson, K.
- Are You Seeing What I am Seeing? Exploring Response Option Visual Design Effects With Eye-Tracking; 2013; Libman, A., Smyth, J. D., Olson, K.
- Does Giving People Their Preferred Survey Mode Actually Increase Survey Participation Rates?; 2012; Olson, K., Smyth, J. D., Wood, H.
- Literacy and Data Quality in Self-Administered Surveys; 2011; Smyth, J. D., Olson, K.
- Medium Node: NSF Census Research Network; 2011; McCutcheon, A. L., Belli, R. F., Olson, K., Smyth, J. D., Soh, L.-K.
- Comparing Numeric and Text Open-End Responses in Mail and Web Surveys.; 2011; Olson, K., Smyth, J.
- When do nonresponse follow-ups improve or reduce data quality? A meta-analysis and review of the existing...; 2008; Olson, K., Feng, C., Witt, L.